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rnformation science (iS) has so far been unsuccessful. Appearance of 
a theory has been retarded by one central constraint, the large 
nuinber of disciplines concerned with human communication. 
Crossdisciplinary interdependence occurs in two wayss theoretical 
relation of IS phenomena to a given science, and practical relation 
of the science to IS dissemination of its contributions. We are 
concerned here with the first* The main difficulty in making IS 
models is the above mentioned interaction of many sciences of 
communication* Prominent among these are physics^ biology, 
psychology^ library science, computer science, several social 
sciences, applied logic and mathematics, and not least, cybernetics- 
That cybernetics should apply to IS is not a new idea. But more 
Frecision has emerged recently. Cybernetics is now seen to underlie 
nearly all IS phenomena through two central concepts: variety, and 
the law of requisite variety. The last provides a quantitative 
approach to system regulation and control. IS concerns regulatory 
activity in typically large, goal^seeking systems. That is, 
propagation of meaningful human messages between sender and recipient 
on an "IS path" is a goal^seeking process, {Author) 
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ABSTRACT 



Search for an integrated, comprehensive theory of information science 
(IS) has so far been unsuccessful. Appearance of a theory has been retarded 
by one central constraint, the larqe number of disciplines concerned with 
human communication. Crossdiscipl inary interdependence occurs in two ways: 
theoretical relation of IS phenomena to a qiven science, and Dractical 
relation of the science to IS disseniination of its contributions. 

We are concerned here with the first. The main difficulty in makina IS 
models is the above mentioned interaction of many sciences of comunication 
Prominent among these are physics, bioloqy, psycholoay, library science, 
computer science, several social sciences, applied looic and mathematics, 
and not least, cybernetics. That cybernetics should anply to IS is not a 
new idea. But more precision has emerged recently. Cybernetics is now seen 
to underlie nearly all IS phenomena through two central concepts: variety 
and the law of requisite variety. The last (stated by Ashby) provides a 
quantitative approach to system regulation and control. IS concerns 
regulatory activity in typically large, goal -seeking system.s. That is. 
propagation of meaninqful human messages between sender and recipient on an 
IS path" is a or 1-seeking process. 

The IS path is biophysical ly and topoioqically invariant' in space and 
time. It consists in three segments, tm within the communicants and one 
external to both. Within this environmental segment are located the 
physical artifacts of IS. All social structures depend on variation and 
matching of the central segment. This includes transmission of knowledge 
and education. The law of requisite variety affects each staqe of 
propagation along an IS path. More spsci+'ica 1 ly, it has shaoed all steps 
in the bibliographic access to knowledge. Applications of the law of 
requisite variety at interfaces in IS systems are described in references 
to papers by the author and his students. 
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A quarter of a century ago cybernetics was founded by Wiener, Shannon, 
Ashby, Beer and many others. In the interval it has become a well 
developed science, Wiener coined the word "cybernetics*' (from the Greek: 
"steersmanship") to designate the science of "control and communication 
in the animal and the machine" J 

Fifteen years ago the phrase "information science" was coined to 
designate an anticipated science looming behind an Immense agglomerate of 
scientific, technical and professional knowledge concerning propagation of 
human messages. The emphasis on communication overlaps that of cybernetics, 
and includes all aspects of the way messages are generated i transfcrmed, stori 
disseminated, received, and used. The field has far-reaching practical 
applications (one of which is communication in science). So far, however, 
the anticipated theoretical science has not appeared. Few or no principles 
have been found that Integrate the vast array of Information scientific 
phenomena. On the other handp since these concern human thought and Its 
communication it seems likely that "IS theory" will be related to scientific 
epistemology. This impression may be strengthened by what follows. 
An aim of this paper is to present a framework for Information 
science--an exhaustive domain containing (but not describing) all possible 
IS phenomena, A second is to demonstrate that cybernetics and information 
science are Inseparably interrelated, and that at least one relation provides 
IS with an initial unifying theory. The relation has an eplstemological 
Implication that extends beyond IS to all science. In carrying this out, 
a problem arises: how to present a rather extensive but needed conceptual 
background to this distinguished but heterogeneous audience, within the 
brevity of a paper. The plan Is to sketch several main concepts from 
cybernetics, describe the Information scientific models, and demonstrate 



the appliC'-bility of concepts to models through selected examples. The 
cybernetic concepts are variety, systems (which are the "objects" that 
show variety), system transformations, system stability, and system 
regulation for stability or "survival" through the law of requisite 
variety. Much of this material is based upon Ashby's classic work.^ The 
information scientific models are the author's "IS path" and "IS domain". ^"^ 
; The IS path is a physical/psychoblological model of two communicating humans- 

similar to but not the same as Shannon's model of a communication system.^ 
: Some of the examples are from recant papers by the authov''s students. 

This article Is divided as follows: 
I Variety and constraint 
II Systems, transformations, stability 
III Requisite Variety 
IV IS models 

V Application of I-III to IV. 
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I. Variety and Constraint 

1, Variety is one of a number of concepts concerned with "quantity 
8 9 

of ujformation". ' It Is a property of a set, not of an IndlviduaK 
Variety 1s simply the number of dlscriminabl e differences which an observer 
can make In observing some systt\.u We say that a system "shows variety". 
Since the d1scrimir>at1on Is made by the observer^ the variety in a set ma^- 
be more (or less) for one observer (or discriminating system) than for an- 
other. Variety can be measured in many ways, the two most common being 
linear and logarithmic. That Is, variety 1s measured either by the number 
N of values or states distinctly discriminated, or by the logarithm of this 
number, log^N, where A 1s some arbitrary base (usually 2): 

V = N , or V ^ loggN , 
N = l52,...,N^5 where is the maximum number of states or values observ- 
able under ideal conditions. The variety in the following letter: 
Dear Dad: Please send money, Love* Your sons 

Is 

12 (or logglZ = 3,58 bits) for the set of letters in the message; 
8 (or loggS - 3 bits) for the set of words in the message; 
1 (or loggl = 0 bits) If the set Is the message as a whole , or the 

unit set, 

assuming we all count and discriminate identically. 

The example shows that any observed object or system can give rise to 
different sets. Psychologically, the above observer "defines" three sets 
by paying attention i^espectivaly to three levels of substructure. First 
hi observes the system the most closely, in its finest detail. In doing 
so the semantic aspect or meaning of the Individual letter symbols 1s In 
the center of awareness, while the meanings of their groupings into words 



IS not, or is less so; and even less thi total purport of the strunture of 
words in the message. In focussirig on the words, he defocusses or gives 
up central attention to the letters, but gains some peripheral clarity or 
greater awareness of the entire message. Finally, in thinking of the mess- 
age as a whole the meanings of the Individual vrardg are defocussed, merged 
and partly lost, while that of the letters is even more deeply suppressed. 
There is an analogy here with viewing a microscope slide at three decreasing 
stages of magnification, or with walking away from an object and paus-'ng 
at three different distances, to look back at it. The object gives rise to 
three distinct sets. 

Another common way in which an object can give rise to different 
visual sets occurs when we do not change the magnification but "scan" the 
object in a sequence of observations. In the background is retained aware- 
ness of the fact that the "object" seen in each view is part of a larger 
whole. However, in no two "frames" does the observer see the name object; 
actually he sees different substructures. Reading a page in a book 1s a 
comnion example. 

2, An impnrtant case arises when the same syitem gives rise to different 
quantities of variety. This can happen if, for any reason, full observa- 
tion is impaired or the variety is "constrained". Constraint on the variety 
of a Sit may arise externany in the system Hself (some of a bank of switche 
work, others do not); or In the communication channel (the telescope 
diaphragm cuts off some of the light); or Internal to the observer (he may 
be color blind). The concept of constraint is fundamental in all science, 
whether based mainly on observation or on reasoning. Information theory 
and cybernetics are founded on It. Just as variety is the number or' dis- 
criminations the observer can make in some systen, constraint on variety 



is a relation betwein two systems'. In this case the two systems are actual 1 
the same system observed under different conditions. The constraint is 
expressed by the difference between the full variety (observed under ideal 
or theoretical conditions) and the variety observed. The absolute con- 
straint is simply the difference 

abs m 

in which V'is the variety observed and the maximum variety observable if 
the set is not under constraint. Relative constraint would be 

Crel = (^m " V) / V, - 1 = V/V^ . 
Using the same definitions of constraint the linear and logarithmic 
measures of variety for the same range (N = 1,2,...,N^) do not give ident1= 
cal values. For example if a bank of three lights each of which can be on 
or off (and therefore ideally capable of 2^ = 8 discriminable states) were 
never used to display more than four states, then the absolute and relative 
constraints for the linear measure would be 8-4 = 4 and 1-4/8 = 1/2; while 

for the logarithmic measure the constraints would be loq«8 - loq„4 s 

2 ^2 

10928/4 = 1 bit, and 1 --. 10924/10928 - 1 - 2/3 = 1/3. Evidently if V»V^ 

then with perfect freedom to vary, or "Independence^ both absolute and 

relative constraints have value 0. However, when the variety Is reduced to 

1 in the linear measure and 0 1n the logarithmic (no freedom to vary), the 

values of the absolute constraints in the two systems would be N -1 and 

m 

loggN^ - loggl = log^N^ , and the relative constraints would be 1 - 1/N^ 
(nearly but not quite 1), and l-loggl/loggN^ = 1 . The two measures of 
variety could be made to give Identical relative constraints 0 and 1 at these 
Intersections of the linear and log constraint curves if we were willing to 
define linear vai-iety V = N-1. They would still not agree elsewhere. 



3. Nowp 1f the reader has gained the Impression that variety and con- 
straint on variety are rather simple concepts, let him not also assume 
them Insignificant, On the contrary, simplicity endows them with a breadth 
of applicability unmatched in science. Perhaps we can put it this way: in 
the mental world variety is comparable to atoms. The nhysical universe is 
built of atomss the mental universe is built of variety. Consider the 
following; 0) that variety is more general than Its closely related 
concept, entropy^ (2) that constraints on variety form the bases of all 
natural laws and formal axiomatic systems;-^ (3) that Drocesses such as 
recollection, iMrning, teaching, predicting, deciding all cognitive and 

evaluative functions depend on structures of variety and Its con- 
n 12 

straints; ' (4) that variety and constraint retain their usefulness 
for cognitive and evaluative processes at all levels, 1,6,, are "Invariant^' 
under, or independent ofi the transformations of abstraction;^^ (5) 
that the law of requisite variety forms the basis of regulation and control 
of systems 

While expressions of constraint tend to be quite different in each 
discipline, of particular interest Is the way in whiLh entropy expresses 
constraint on a set in information theory:'^' ^- 

in which Pj is the probability of occurrence (in a long sequence) of the 
variety In the jth state, given n states. Entropy measures an average, the 
average of the Mnformation' "loy2^j state, over all states 

(j = li2,...,n). When there is no prior knowledge of any particular out- 
come all outcomes are equally likely and P. = 1/n, for all states As 

is well known the expression for entropy becomes 
n 

H ^ 1og2(Vn) ^ n/n log^n ^ loggn 



and this is also the maxiniuni value taken by the entropy* The condition 
for maximum entropy Is Identical with the condition for least knowledge 
about the set of n states or values i i,e,^ for independence of probabilities 
of occurence of the outcomes, for "absence of constraint", not on the : 
occurence of variety but on the relative frequency of occure nce. I t 
is also the condition for equivalence between Hartley's original measure 

\ of "Information capacity" and Shannon's entropy^^' i and finally^ it is 

equivalent to the logarithmic measure of variety in the set. The logarith-- 

■ mic measure of variety can be regarded either as a simplification to 

which the measure of entropy of a set showing variety is reduced when 

additional knowledge about the states (frequency of occurrence) is least (i.e,, 
i entirely lacking) or; as a measure of something more general than entropy. 

Entropy requires for Its specification additional knowledge, knowledge of 
the relative probabntties of the different states of variety. Hartley's 
information capacity was conceived as the mtasure of the number of 
different units ( whose individual capacity Is shown by the log base) 
needed for physlcany storing a "representation" of a message of n distinct 
symbols, without regard to possible constraints of which one could take 
I advantage. That Is^ storage capacity takes no advantage of the relative 

frequencies of occurrence of the symbols, 1n order to recode the message 

I 

I to a lower capacity. The minimum recoded capacity was Tater^deflned as 

the "information content" to distinguish it from "information capacity". 
Variety, information capacity, maximum information content, and maximum 

I entropy are numerically equal. 

We now see that entropy need not enter a discussion of variety unless we 
( require not one but two kinds of information. Variety is a more primitive 

concept based only on discriminabil ity and not also on relative frequehcy of 



ERIC 



. 8 



occurrence of what is discriminated. We need entropy for, e.g., efficiency 
of coding messages into a given channel or space. We do not need it for 
an inquiry Into the applicability of the law of requisite variety to infor- 
mation science. In fact, the general applicabnity of this law to all 
forms of regulation might be reduced 1f we had to know too much in order 
to use it, 

4. The discussion could be prolonged, for variety 1s related to 
fundamental thought processes. We confine ourselves to two comments. 
First, thei-e is an apparent inconsistancy between "operationaT' definitions of 
the measures of variety and constraint on variety. The former is 
defined as the number of discriminations in relation to the observer-- 
those he or she discriminates. If for any reason the number is less than 
the full variety the observer cannot necessarily be expected to know this. 
How define a constraint (which requires knowing the full set, ) that 
one cannot observe? The Inconsistency 1s removed if one or more other 
observers (who represent "objective" scientists measuring the constraint) 
can observe both the unconstrained and the constrained sets; or if the 
same observer can in some way determine how much less he observes than he might 
observe. The formulas are therefore valid for one observer who can sub- 
jectively compare the two sets, or for two or more observers who objectively 
determine the full variety and the variety accessible to the observer. The 
writer has suggested elsewhere that all obsirvation 1s, strictly speaking, 
subjective^ and that what we call objective 1s simply a subset of the suboectlve 
more completely checked by intercommunication.^^ 

The second comment is to call attention to the extreme versatility 
of the' concept variety. Logicany, we could better undirstand this after 
discussing the law of requisite variety, for that law expresses relative 
versatility in coping with difficulties. However, two simple examples 
Will show what is meant. The variety in color discrimination is a sensory 



experience at the most concrete level, that of the direct sense iiTipression 
or DSL The variety in a set of logical outcomes is abstract. Consider^ 
for example, the conditional proposition on which are based the hypotheses 
of science: 1f A then B, The conditional is a single statement compounded 
from two elementary statements A and B, each of which can have two attributes 
(or states) 5 true or false. The truth table is 

A B A B 

T T T 

T F F 
F T T 
F F T 

In other words the conditional defines an abstract set, all the possible 
outcomes which can occur, given the four hypothetical combinations (TT, TF, FT, 
FF)- As long as there are no restrictions on the possibility of occurrence 
of any combination of states of A and B, the set displays full variety: 
4 or 10924 ^ 2 bits. If, however, by any Independent means it is possible 
to add the observation that the state (TF) never occurs, then the variety 
in the truth table is reduced from four outcomes to three* The proposition 
is now universally true (all T), and the conditional has been converted into 
an implication: A implies B. This 1s a set relation, a new property acquired 
by the truth table set by reason of the constraint on its variety, -° 

The example demonstrates that in logic and mathematics, far from the 
concrete end of the spectrum of abstraction, the concepts of discriminable 
states, variety, and the formation of relations through constraints placed 
upon the full set of states are applicable. Whether we are dealing with a 
discriminable set of direct sense Impressions or with an abstract set, we 
can measure the variety of the set, the constraints on the set, and the 
resulting relations on which our rational thought depends. More vividly 
we might say that discrimination and counting discriminations are invariant 
Q undir the mental transformations of abstraction. 

ERIC 
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II. Systemsi TransfQrmationSi Stability 

.1 

1. The concept of a system 1s so widispread that it 1s used 1n all 

r _ 

f science. What are the common characteristics of systtms? The author = 

has suggested that a system is an abstraction from a real object: 

i 

I ■ • • _ . 

^ The reason for including our subject within broader classes 1s 

simple* Human thinking 1s performed in terms of classes * and 

I a system of any kind 1s simply a class located within a larger 

I class--1ts environment. The processes of the system may be diyided 

into what have been called its "internal transformations % and 

^ those processis which cross boundaries and relate it to Its 

I environment*- 

Since a class is mental i a system Is a mental construct, changeable 

,3 
.1 

i. at the will of the concelver. We usually draw a mental boundary around 

I the system, such that Internal and external parts, and relations 

between parts^ are separable. We feel no compunction in shifting attention 
; to a part or subsystems and calling that the system. This is precisely 

what we did In the case of the example of the different sets to which an 
I object or system can give rise. Thus systems can form ordered hierarchies 

I of sets, and mathematically can be treated abstractly, e.g., by lattices. 

The abave is perfectly general ^ and applies to all systems--they 
j retain the trace of their origin by always having an environment-- the 

distinguishing feature of a real object. Real objects also change, and 
I all except the most trivial systems are subject to transformations. The 

s system is said to be In some *state% fixed by a set of values of the 

variables which together define the system^ or often, simply by a single 
I symbol which defines the state. For ilmpliclty, using only the latteri 

cdnilder the systim whose states are given by set'CAj B* D} . Its 

1 transformation T is representable as follows 

A B C D 

j ^ ^ B C D A 

jERiC n 



We call tne initial states (top row) the 'operands', the final 
states the 'transforms'. The transformation T is also shown graph- 
ically in Fig. la. The transformation shows that if the initial state 
of S is A , at the next "step" s will be at state B . if the 
transformation is repeated twice, we can say that the transformation 
takes the system S from A to C , from A to D , and so on. 
If the system is a model of a real object (has a real referent for the 
mental construct) then it will take a finite time t^g for the system 

to be transformed from A to state B , another interval t^^ for 

BC 

the second transformation, and so forth. For simplicity let us assume 
that all the steps take an equal time t , and that the transformation 
is repeated as soon as each 'step' is conipleted. Then system S will 
go through all Its states in succession, and cycle back over them, 
indefinitely. Given the initial state A and n steps (or applying 
t") we can predict exactly in which state system S will be at the end 
of time nt (e.g., if n = 5, the system will be at B ). Suppose, now, 
the time interval nt represents real time. Then we have a way of 
schematically representing how any real object passes in succession 
through its various states. More generally, we can think of the system 
S as being the real world about us, transformed stepwise (each moment 
of perceptible duration) into the real world of the next moment— some 
of it remaining unchanged, other parts of it changed into new states. The 
steps can be short enough so the change seems continuous. Transformations 
are the formal way of representing either changes in real time of real 
objects, or purely hypothetical changes. 

Now suppose that system S has a more complex structure represented 
by the following set_ of transformations s 

12 
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d B D B D 
e A B C D 
f D X D B 

23 

This rtpresents a "machine with Input". Each row represents a 
possible transformation on the four states A* B, Ct D * In row a i 
the machine transforms as before^ in only one manner--shown In Fig* la. 
This Is Its Internal mode of operation as long as nothing changes the 
system. Now the only thing that can change system S is not Inside 
it, for S is determined by its transformation (-'internal constraints") 
T , Therefore! the only possible agent which can change S from its 
mode of function in row a is some external agency—in the environment. 
If something in S's- environment shifts the "input" parameter from 
a to b J then S now transforms according to the new mode of row b , 
shown In Fig. lb. The input from the environment is said to control 
the states to which S transforms, these states being S's output. That 
is, we think of the system S 'coupled' to the environment so that the 
'supersystem' of S and its environment forms one machine. The environ- 
ment ^drives' S in the sense that it selects the parameters (aibs...,f) 
i.e., not the Initial state of S but the transformation. Again, the 
output states of S can be the input to a second system, U coupled 
to S , such that the transform states of S are the parameters which 
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select the Internal transformations of system U . In this way we can 

model Intricate relations between environment and systems, or between 

subsystems of any syitem, coupling them through their inputs and outputs. 

We can go on to design model systems of components subsystems which perform 

according to actual or theoretical requirements. We can test the 

operations of these models by the use of the coupling transformations 

24 

and the internal transformations. Thus cybernetics is a ''science of 

the artificial" in the sense that its chief concern is system analysis 

25 

and design (for control) of systems^ or artifacts. 

Returning now to our extended set of transformations T of machine 
S with inputs a-f 5 we know of course that with four states and no 
constraints there could be 4^ or 256 different modes of internal opera- 
tion. The fact that there are only six 1s therefore a large constraint on 
the variety shown by S , The constraint defines the system S , The^ 
first five rows show a few characteristic types of internal transformation. 
In a , there is one "basin" , with a complete cycle; 1n b two basins 1 
and twc; cycles; In c one basin with a terminal cycles in d one basin 
and a terminal state at which the system comes to "rest" in the sense 
that it transforms identically into the same state D after, at most, 
two steps* In e the four states transform Identically into themselves 
such that if the system starts in any state it remains there. All rows 
represent single valued transformations; In the sense that no state 
transforms to ("maps into") more than one state. "Single valuedness" 
1s the absolute minimum we can require of a "determinate" machlnti i.e., 
one whose states can be predicted. (Note: stochastic machines 1 not dis- 
cussed herej retain some predictability). The machinei however, can be deters 
minate without resembling our usual idea of a machine, which must continue to 

14 



operate . This added feature riquires a closed transformatioiip one in 
which no new states appear in the transforms that were not present among 
the operands* The variety of internal states must not(^crease. Rows 
a through e are closed^ and represent our idea in^.'^lnes (single 
valuedi closed transformations). However^ these five machines (or five 
modes of operating one machine) are quite distinct from eachother. The 
machine represented by row a cyclesi and retains all its Initial variety. 
In addition to being single valued and closed^ Its transformation Is 1-1 
(as many different transform states as operand states). Row e also 
preserves its variety. But herei if the system starts 1n any operand 
state It remains there. An observer would -not discover the other states 
either before or after transformation^ and would not^know 1t had inter- 
state variety. In row b only two states of the four would be observable^ 
In rov^ c states A and B might be observed but would never recur after 
the second step—after this step they would be "Inaccessible". The same 
would be true for row d after the second step. We conclude that, with 
a finite number of states s a system that is repeatedly transformed can 
at most retain all its Initial variety. It does so only if the transforma- 
tion is 1-1 at each step. Much more often the transformation is many-1 for 
at least a few steps, and the variety shown by the states decreases. If the 
variety in a machine is used to code messages, after repeated transformations 
the information In the messages is at most preserved , and usually decreases. 

2. System stability Is closely related to system transformations. 
Finite state systems such as that in Figure 1 either come to equilibrium 
at a single state (rows d and e ) or to a terminal cycle of states 
which we might call 'cyclic equilibrium' (rows a,b,c), A stable system 
1s simply a system that, after displacement from an equilibrium state 

15 



or cycli to soma other state, eventually returns (under the original 
transformation) to the original iqullibrium state or cycle. 

In order to displace a systan In tqunibrlum, since the system 
Itself cannot do this the displacement must come from without. The 
displacement therefore occurs through a shift to a new row of trans- 
form states, and the starting state transforms accordingly. 

Consider the following single row transformation of a system with 
four states: 

A B C D 

T + 

A A D D 

As shown in Fig. 2a , this system has two basins and two states of 
equilibrium. It can represent a machine, since T is single valued 
and closed--even though the machine stays quietly either at state A 
or state D after one step. 

Now let the system be displaced in one step. Three different 
displacements (D^, Dg, Dj) are shown below, with T above each: 

+ ABC D +ABCD +ABCD 

TAADD TAADD TAAD D 
D^C BDA DgDCAB D3DXDB 

Suppose the starting state is B . The one-step transformation 
is D^(B) = B , and the next step (under T again, after displacement 
ceases) is TD^(B) ~ A . Therefore the system returns to the same , 
state of equnibrium (A) , and is stable under . If the starting 
state had been D, however, the system would regain equilibrium, but In 
the other basin, at A . That is, TD^(D) - A . Therefore if the 
starting state Is D the system after dtsplacement is still a 
machine, still in equnibrium, but not stable. 

16 
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DgCB) = C , and TDgCB) * D ; while DgCD) = B , and TDgCD) = a 
so that we have the same Inversion as above. Here, however, no matter 
what starting state is used, the system is unstable. 

D3 has the same row as f , in Fig. If. And 03(8) = X ^ a 
new state. The system cannot transform again according to T , and there 
1s no recovery. Interpreting this as the operation of a real machine, 
the machine has passed Into a state not only of "no return" to its 
initial state of equilibrium but of impossibility to continue. Its 
existence as a "machine" ceases. Thus we associate the closed transfor- 
mation with "continuity" or survival of a system; and a single valued, open 
transformation is a machine only in the sense that It may start off , 
-perform one or more steps , and then permanantly stop. If a system stops at 
a state or cycle of equilibrium it can be "started" again by external 
means. But if it stops In a new state there is no way, even for an 
external agent, to get it back into .a state from which it can continue to 
perform. It has undergone an Irreversible^ final transformation. 
Picturesquely, we can say that the system is destroyed. If the system 
represents a living organism or organization, it is dead. 

3. In the directed graphs ("digraphs") of Figures 1 and 2 a vertex 
(letter) represents a state, and an arc represents the transformation. 
The arc is directed from the operand to the transform state. In an- 
other form of digraph called a "diagram of immediate effects" vertices 
(in boxes) represent parts of coupled systems if connected by arcs, 
independent or "reducible" parts if not. The arc direction shows 
output (arc leaving) and input (arc entering), part A whose output 
is the input to part B 
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A dominates B 



A and B are independent 



selects the rows of B's transformations and regulates, controls or 
"dominates'' B. If there 1s also an arc from B to A 



A and B are symbiotic 



the two subsystems operate by "feedback". Each "lives" symbiotic 
cally in the environment provided by the other. For a fully-connected 
digraph of more than two vertices the concept of simple feedback be- 
comes Inappropriate, It is Intuitively apparent that parts of systems 
harmoniously (non disruptlvely) coupled by reciprocal inputs and out- 
puts must synchronize their internal transformations so that all trans- 
formation times are Integral multiples of each other (a natural time 
quantization). Further, if one part Is in cyclic equilibrium, so 
must be the other, otherwise 1t would "veto" ("disrupt") the internal 
transformation of the part or parts It dominates (e.g., a strike by 
bus drivers^ or longshoremen). 

If several vertices (A,B,C,D) are coupled Into a chain so as to 
form a "communication channel" 
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1t may take two or more steps (or time units) for the actual dominance 
of A nver C and D to become observable. After three steps the above 
becomes a '-dlagrain of ultimate effects" 

Possibly the main use for this kind of diagram is 1n connection 
with the law of requisite variety. 
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III. Requisite Variety 

The cybernetic law of requisite variety combines several ' ideas 

already described. It is readily understood by a diagram of Immediate 

effects with four main parts (EsDsTsR) coupled as shown (Figure 3a). 

Let E represent a set of "essential variables" which 
must be kept within certain limits in order to achieve a 
goal. Let D be a set of disturbances or threats to E whichp 
by acting on E through the environment Tp can drive E's 
variables out of the region of stability for attaining the 
goal* Finally, let R be a regulator interposed to keep D 
from disturbing E by driving its essential variables out 
of bounds. Then the law states that R can successfully 
"requlate" D only if it has "requisite variety". That 
is, R must have a variety of alternatives sufficient to 
counter the variety of disruptive alternatives open to D.4 

The discussion could be given In terms of states^ or of variables. 

The latter may be preferable for visualizing limits. If an 

organism can survive within a temperature range (say) -ZO^F to +120^F 

2 2 

and within a pressure range 3 lbs/in to 45 lbs/in , such ranges 
represent the kinds of limits within which the organism (set of vari= 
ables E) must be kept- If E Is a machine^ the machine has a like set 
of working range limits. These also can be viewed as ranges of stabi- 
lity. For continuation of E as a system is a goal fundamental to 
whatever other goals E may have. Thus we can partition the total set 
of values of E Into (the subset or region of values for survival) and E_(all 
other regions). The problem of regulating D ISg simplys to keep D 
from driving E Into E_; or to keep E within subset E^. If D is a 
"natural disturbance" it has no "objective" is not out to defeat E 
as would an opponent in a game. So some of D's acts may not harm or totally dis^ 
able E. Nevertheless, in stating and presenting this central law of 
cybernetics (for naming and discovery of which he Is credited) Ashby 
represents the situation as a contest between R and in a two 
person "matrix game". The elements of the matrix T are the outcomes 
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of the joint interaction of D and R on acting through the environ- 

ment represented by Table T of matrix outcomes. Some outcomes in T 

will leave E within E^s free to continues others within E_. 

Consistent with our picture of equilibrium (a displacement followed 

by a recovery to an state) the game consists in two moves: 

D plays firsts by selecting a row of the matrix, R 
counters p by selecting a column. If the outcome (value of 
the matrix element jointly selected by D and R) is within 
E_^s then R w1nSs "regulating" D, Otherwise R loses* Only variety in 
Roan "drive down" or "destroy" the variety in D,21 

In Figure 3a regulator R receives notice of D's move directly, in time 

to make the best possible countermove in selecting a column of T. 

Replacing E^ by "+" and E_ by ''-'S a game might look like this; 

R 



D 





1 


2 . 
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+ 








b 




+ 






c 










d 











With the particular table T shown, using only the first three 
columns (R-s moves: 1, 2 or 3) and four rows (D's movesi a, b, or 
d), R can win If D plays rows a, b or c; and R loses if D plays row 
d. To make R into a "perfect regulator" such that E never experiences 
D's movesi we should have to Increase R's varletyi We could accQmplish 
this by constructing a more versatile regulator R with four Instead 
of three optional moves s such that there is a on row d (dotted 
vertical lines)* 
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Obviously the situation changes with the structure of table T. 
In certain cases R can nevir win. In most cases R can reduce D's 
variety so that, while there may remain some possibility that D wins, 
the chance of immediate termination 1s reduced. The mathematical ex- 
pression of the law of requisite variety takes the form of an inequality: 

V'(D) a Iff} (linear), V'(D) a V(D) - V(R) (logarithmic). 

This states that V'(D), the reduced or resultant variety which D can 
exercise, exceeds or at least equals D's original variety V(D) divided 
by R's variety V(R). In Ashby's words: "The variety in the outcomes, 
if minimal, can be decreased further only by a corresponding increase 
in that of R".^^ obviously, if V'(D) = D, (logarithmic measure) D has 
only one mode of affecting E, and R needs only one effective counter- 
move. Even If V'(D) is a small number the regulation may still be perfect 
or nearly perfect. The essential is that, by reducing D's variety E's 
chances of survival are Increased. This is the case with organisms 
and organizations in ordinary living. There Is no perfect regulation (as 
in Figure 3b), no guarantee of continuity. All "live dangerously" — 
i.e., contingent on the capacity of their regulators to reduce D's variety. 

There is a systematic decrease In the amount of regulation R can 
provide, even with a favorable table T. In Figure 3a, as mentioned, 
the channel of communication by means of which R learns of D's move 
is 1-step, and we Interpreted this as rapid enough so that D and R 
simultaneously act on T, and (if T is favorable) that it is possible 
for R to completely shield E from "knowledge" of D's move. In Figure 
3b this was shown by "no message" getting through to E from D. How- 
ever in Figures 3c and 3d the situation becomes progressively lass 

22 



favorable. In Figure 3c the path of communication needs two steps ^ 
and R can regulate D only after D has acted on the environment, but 
before the environment acts on E. Here the chance of R*s selectinq a 
"correct" move is Impaired by the length of time delay and it be- 
comes evident that "R*s capacity as a requlator cannot exceed R's 

2fi 

capacity as a channel of communication". In Flqure 3d R learns of 
D's move only after it has affected E. In this situation, that of the 
"error controlled" regulator, the best that R can do 1s let E suffer 
some losses (which are still in and not fatal) but which do 
indicate the threat; and then counter with a move that restores E to 
a better position in the "survival region". In other words, with the 
minimum 3-step channel R can never be a perfect regulator, but always 
an imperfect one. This type of partial protection predominates in 
nature continuity is contingent on developing better regulators. 
Businesses fall, empires fall, healths decline, species die out If 
disturbances cannot be regulated after -^the-^fact. 

It is possible to add another part to the diagrams of Figure 3. 
This IS a "control" with input to R 



c 




R 


— ) 



In this case R actually has two inputs, one from D, T or E and 
one from C. The effect of the inputs from D, T or E Is to enable R to 
select a column in T. The effect of the Input from C is to change R's 
input parameter Its row. Thus C dominates R. This may work well, 
since it is an easy way to increase R's variety by giving it, not 
simply one row of column choices, but several rows* However, 1n the 



light of the fact that R's effectiveness depends on its capacity as a 
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communication channel (an "error-correcting channeV 1s more precise ), 
If C does not also share the Input to R (1s not as Informed about 0 
as IS R) the added mechanism (R and C actinn as a unit with T to protect 
E) may not be more effective than the simpler mechanism (R and T acting 
toaether to protect E). In regulation R has a sinqle row of options^ 
while 1n control R has more than one row. This 1s analogous to the 
"machine with Input". Control C dominates R's transformations! i.e., 
R's selection of a columnigiven a row selected by D. 

Ashby makes the point (p. 214) that "perfect regulation of the 
outcome by R makes possible a complete control over the outcome 
by C What I then^ is a perfect regulator? For R to be a perfect 
regulator two independent conditions must be satisfied. The following 
is one such pair: 

1* R has ^'requisite variety" [a sufficient number of columns 
in Table T) so R can always select a favorable outcome 
(member of {E^Ji^ 1f 1t exists^ In any row selected by D , 
2, No row of T contains only unfavorable outcome elements 

(all members of <E - - E^}), 
Condition 1 can be said to depend on the quantitative aspect of 
variety* In this case it is the relative number of rows and columns 
in Table T. Condition 2 can be viewed as depending on the qualitative 
aspect of variety - in this case the intrinsic structure of Table T, 
Each row of T must contain at least one member of {E^> . This shows us 
that the two conditions for perfect regulation cannot always be 
satisfied solely by design of regulator R * If any row of T exists 
such that R cannot select a favorable "target-- in spite of Its 



capacity to select any colunin, then R is an imperfect regulator. 

The row condition, "Invariant unfavorable outcome" (lUO), 
does exist for all real systems E . It may not be evident. A 
physical embodiment might be a row of elements corresponding to any of 
the following disturbing events (war, epidemic, nuclear explosion, 
extraordinary solar radiation, impact of a large meteor, planetary 
orbit dislocation with high index tidal waves and earthquakes, etc.}. 
Any catastrophic "act of God" can produce an lUO. For these no 
foreknowledge or preselection by R or C can avail. Thus satisfaction 
of the law of requisite variety does not completely insure effective 
regulation. We must also satisfy the condition of at least one favorable 
outcome for each component of disturbance. This qualification in no 
way reduces the central importance for regulation of the law of requisite 
variety. It does show that in humai. and all biological affairs 
survival is contingent. lUO is always potentially present, however 
unnoticed. These observations can be sunmed up by a logical statement: 
satisfying the law of requisite variety is necessary but not sufficient 
for perfect regulation. Alternatively, system survival implies 
requisite variety In the system regulator, but the converse 1s not true. 
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IV. IS Models 



These models have been discussed at various times, ' - The 

first, the -IS path'' (Fig, 4)p is a diagram representing schematically 

a one-way path of message propagation from an individual A to an individual 

B* Quoting References 3 and 4: 

The over-all path consists of three segments i each composed of 
many stages. Segmental Is In ir.dlvldual a, the author or sender 
of the message. Segment ba 1s in the environment or medium [or 
media] surrounding A and B, Segment ad 1s in individual fl^ the 
recipient of the message. The entire path is physical in the sense 
that all of Its stages are subject to the laws of physics. We 
will call ba the external path segment (also "external segment," 
"external path," or "physical I1nk")^ ab the organic efferent path 
segment, ad the organic afferent path segment. Individuals A and 
B possess many peripheral sense organs and motor organs, but 
these are represented in each by a single effector or motor organ 
M, and by a single sensor or sensory organ 5, The organ M is used 
to modulate suitable physical systems used as message carriers 
through Intervening medium ba. The organ S is used for reception 
and transduction of the modulation within the same sense channel. 
However, It is not necessary that both M and S correspond to the 
same sense channel^ provided suitable translaters and transducers 
exist. Each individual, A or is provided with a nervous 
system that conducts afferent modulation from peripheral sense 
organ s to central region C, which we call simply the "mind". 
It also conducts efferent modulation from c or a region near c to 
peripheral motor organ M, The exact locations of M, and c within 
the body boundaries are not material to our picture. But the 
fact that part of the path of propagation lies in each body Is 
essential. 

It will be noticed that what the communication engineer usually 
thinks of as the path of propagation 1s external path be. The 
stages of this part of the path extend from the boundary of the 
message sender through possibly many media to the boundary of 
the message recipient. These stages may have widely differing 
conditions of propagation. They may Include natural media such 
as air^ water^ and solids; or man-made media such as transmitters, 
receivers, and 1nformation-storage»and -retrieval systems, ba may 
include organic, possibly living structures. But in general, the 
media outside the boundaries of A and B are purely physical and 
"non-semant1C|" in the sense that they do not contain the special 
message-initiating and message-receiving equipment located in the 
communicating organisms. Thus^ relative to ^ and 5^ bo is simply 
a set of stages not including the bodies of A and B, through which 
the modulation passes without the special processing that occurs 
in nervous systems (later referred to as "association"). In ba^ 
modulation remains invariant if it Is propagated in the absence of 
noise. We assume the range of ■ propagation to be such that the 
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power level remains high enough, and distortion low enough, for 
complete discrimination by B of the modulation encoded by A. The 
message may be amplified^ regenerated^ and transduced many times. 
But it remains simply modulation, physically transducible Into 
itself In the form in which it left 4's modulating organ. With 
noise, the modulation deteriorates according to the second law 
of thermodynanilcs, and its "bit content" of Information deteriorates 
according to the mathematical theory of communication. In mciny 
ways the purely physical modulated ca^^rler in path segment ba Is 
the simplest form assuitied by a message as It passes from A to B. 

Before generalizing this model, let us sketch In one more feature: 

All messages may be divided into two classes: those of 
short duration (SD) and those of long duraticn (LD), Of these, 
SD are the more basic 1n the sense that we could communicate with 
only SD messages but not with only LD messages. A message In its 
simplest form consists of two components* The first is some physical 
system, which we will call a "carrier," that is not In itself a 
message (examples: radio waves without the voice or music "intelN 
gence^'; a blank sheet of paper). The second consists in discrimlnable 
marks on carrier such as Images or sounds (SD) or printed letters 
Or drawings (LD) which we will call "modulation". The carrier 
can exist without modulation but not the reverse. In SD messages, 
the modulation varies In time. The marks on sound waves In direct 
speech change constantly at the ear = in fact they must die away 
(be attenuated) rapidly, 1f we are to be able to discriminate the 
next words or musical notes. If they persisted for even a short 
time more than they do, the sounds of successive speech or music 
symbols would become indistinct and blurred,.. It Is of the essence 
that SD messages be attenuated at least as fast as they pass into 
the sensor of a human recipient or of a machine-receiver. Somewhat 
more formally: the attenuation rate of the channel which conveys 
information to the sensor must equal or exceed the Information 
rate of the sensor. By information rate is meant the time rate 
of change of fully discrimlnable "least units" of information such 
as word-symbols, or of their components, such as "bits". Unless 
we refer specifically to bits/second or other rate units, by 
"sensing rate" we shall mean "words/second". 

The reason why SD messages are more basic than LD Is simply 
that when the message passes into the sensor of man or machine it 
must do so In SD from. Human sensory (afferent) and motor (efferent) 
messages travel by time-varying modulation to and from their 
destination or source - usually the brain. The same is true of 
machines which pass information through a sensor into some "decision" 
mechanism* 

In contrast with that or SD messag-i, the modulation of LD 
messages persists for comparatively enormous time Intervals, In 
order to achieve this extension Into the time dimension, the carrier 
is restricted in most cases to a solid, and the modulation, instead 
of temporal p Is spatial. Printed letters on a page store their 
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contained message for long piriods. They do so by extending 
spatially on the page. Naturally^ since both SD and LO modulation 
exist in space and time, both are four-dimensional '-niarksJ' But 
the far shorter time duration of SD Fnodulation makes us refer to 
it as "purely temporal which It Is not.,,, , 

Because of this constraint on communication - that a message 
must enter the sensor in the SD mode - all "stored" or LD messages 
must be convertible to SD form. This is indeed the case. It is 
also true that many SD messages are convertible to LD modep but this 
was not always so - and the conversion Is man's peculiar discovery* 
He found that Information in LD mode can be stored^ i.e., propagated, 
into the time dimension^ even beyond the life of the message sender^^O 
The discovery enabled the cumulation of knowledge - the possibility 
for man's finite brain to tap a much larger memory than his own*3^ 
Using this technique of storage as a tool, he erected science and 
civilization* But it is a basic constraint on use of the tool 
that stored messages be retransformed into the SD mode.S? 

One reason for introducing SU and LD modes is that they enable 
us to define with some precision the domain of information science^ 
as distinct from that of other sciences. Like all definitions^ this 
one is only as sharp as the concepts (or the classes) used. Consider 
Fig. as an overall model of three coupled segments^ such that the 
coup! ing between segments is always in the same relative spatial and 
temporal order shown. Spatiallyi it does not matter where recipient B 
is located 5 but B 1s always separated from A by an "Isolating" segment^ 
be • Temporally, A sends the message prior to the time at which B 
receives it. Two general classes of human communication now arise, 
depending on whether the message is propagated solely in SD mode, or is 
transformed Into LD mode at some stage in segment be, and then retrans- 
formed to SD mode for terminal coupling with B . This Is shown 
schematically in F1g. 5. With SD-only propagation the main time delays 
tend to occur a. the terminals ("source and sink" in cybernetics; 
"sender and recipient" in information science). This involves 
a relatively tight bond. The recipient usually must Identify 
the sender, or at least have a channel that connects back 
to him. The path becomes a closed loop typical of the conversational 
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mode, and also of feadback regulation and control. The closed loop 
predominates in all society, primitive and modern. Radio, telephone, 
television and other rapid signal transmission systeir.s tend to retain 
the small time delays in the central segment, almost essential for 
closed loop communication. This is the main domain of cybernetics, for 
without control of the sink by the source possibility of regulation is 
greatly reduced. On the other hand open loop communication is the 
principal domain of information science. We now define it in 
terms of the concepts introduced so far. The propbsed domain of information 
science is simply the set of all three-segment message paths (i.e., 
initial and final segments are living humans whose signal sending and 
receiving organs are appropriately matched to the channel of the signal 
in the central segment, the environment; and sender-environment coupling 
occurs prior to environment-recipient coupling) such that the mode of 
signal propagation is usually but not exclusively SD-LD-SD (or briefly, 
"SLS"). 

It will be noticed that, since SLS predominates on the "IS path", 
time Intervals between the two couplings of the three segments may be 
very long. In fact, transduction at b may precede that at c by years, 
centuries, milleTiia. The LD message acts as a variable storage device 
and variable time delay which combines enormous versatility. A third 
kind of versatility is the "serial addition" of recipients, since the 
message may be "non-destructively" md out of its LD carrier at various 
times; and the "multiplication" of recipients through message replication. 
Thus the LD message enhances man's capacity to carry a message in his 
mind, lengthens Its retention often beyond his lifetime, and extends the 
number of recipients beyond his capacity to contact them in space and 
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time. If we regard the general goil of a message as "reaching a set 

of recipients", then the L,D mode greatly Increases' the alternatives 

open to the sender for goal-fulfillment. 

The above generalization of the model of an IS path to that of 

an IS domain as the set of all such three- segment paths has been 

criticized from the operational point of view. The concept of the IS 

domain was shown to be sharpest and clearest for small spatial and 

temporal intervals between sender A and recipient B. This resembles 

the increasing difficulty of an operational definition of "simultaneity" 
32 

in physics. However, by changing the set of operations performed 
to define the concept, from those of a single observer to those of a 
social group (scientists), the operational definition can be extended to 
longer time intervals,^ 

Before discussing the Impact of cybernetics on these models, 1t 
should be clear from the discussion that cybernetics is the science of 
control of systems, for which communication turns out to be the means of 
controh while information science is the science of propagation of 
meaningful human messages. The two fields are intimately related 
through concern with communication, but with Inverted emphases: 
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V- Application of I-III To IV 

Cybernetics makes, Its main impact on information science through the 
concepts of variety and its transformations along the IS path, and of re- 
quisite variety at all path stages requiring regulation. Mow Ideas which 
apply generally to many if not all situations must themselves be simple, 
generals flexible, without too much structural detail. The concept variety 
has been shown to enter Into all cognitive processes 1n one way or another. 
However, the precise way always has to be defined for each particular case. 

The law of requisite variety has a simple structure displayed graphically 
in a diagram of immediate (or of ultimate) effects. Even so, the set 
{E,D,T,R,C} are not always readily identifiable 1h applying the diagram to 
a given situation, in fact, each variable is often multiple In structure, 
and expressible as a vector. 

In applying the law of requisite variety to the three segments of the 
IS path it soon becomes obvious that the weights of the segments on informa- 
tion scientific phenomena are unequal. By far the most significant phenomena 
occur in terminal segments ab and cd (I and III). 

The most critical processes In access occur in minds, not in 
data files, libraries or computers. Access to knowledge requires 
completing an IS path -- connecting two minds across a variable 
physical segment. 33 

For this reason we divide this section Into two., First we discuss the 
most difficult subject cybernetic applications to the terminal segments 
of the IS path. Here we are on much less firm (or observable) ground than 
in discussing the second segment, be. The terminal segments are among the 
most difficult and complex regions of investigation of nature — the regions 
of human cognitive/affective/motor systems. These systems are of course in- 
volved in other sciences. 
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1 . Requisite Variety and IS Path Terminals 



In Section rlt was mentioned that the concept 'variety' applied to all 
mental levels of abstraction. These and a theory of conmunication have been 
modelled. -^'^'^ 

The mental levels are not hereditary but built up as new 
structures, by the body. They are constructed from traces of direct 
sense impressions (DSI's). Stored DSI's were called SSI's, and sets 
of naturally associated SSI's were named I-sets. Abstractions from I-sets 
were called A-sets. That is, an abstraction was presented as a single 
mental structure based on association of a finite number of SSI's. Two 
main kinds of association were recognized: natural association and 
conditioned or Pavlovian association. The former gives rise to our 
concepts of real objects , and through external and internal (body) con- 
straints preserves the original order in space and time of the sampled 
stimuli. The latter are associations of arbitrary partial patterns — 
simpler than the patterns in natural DSI's, yet, because sensed, yielding 
DSI s. ^ They are symbols, and their role is to be arbitrarily associated 
with ("attached to") the naturally associated A-sets or concepts. 

Physically associated with the concept, the symbol DSI when re- 
ceived acts as a trigger, handle, or switch evoking the abstract concept 
to which it is conditionally associated out of latent memory Into active 
awareness. Thus in "conversation" a speaker "plays upon the keyboard" 
of the recipient's A-sets by means of the attached. symbols, i.e., (SSI's 
triggered by) DSI's. For only a stimulus, leading to a DSI can cross the 
inter-individual separation (segment bc).° 

Sensing and storing sensed data in memory (I-sets) vastly increases 
the variety of direct experience available to man the self-regulator. He 
is able to encompass a wider panorama of his environment, a longer time- 
span than if he were memory-less. Thus we may regard memory storage as a 
direct application of the law of requisite variety. It gives man (R) more 
options in the form of greater awareness of disturbances, (D), real or 
potential, in his environment. 

On the other hand, if this were the only cybernetic device at work 
it would soon come to a halt in the face of an even greater disturbance 
than ignorance of environment. This would be the inability to respond and 
act because of the complexity of variety stored. Therefore we look for. 



and soon find, another device to relieve the flood of sensory data. Using 
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stored sensory data as base, the body forms (non-destructively) new "higher" 

mental structures. It does so by "abstracting" a greatly reduced number of 
I simplified homomorphisms. That is, the second application of the law of pequisite 

variety Is not to Increase variety available to R, but to decrease variety 
in D. 

: "... the object of a homomorphic mapping Is to make a many-one 

reduction of variety. "34 

The effeuu of reducing the complexity of variety to a manageable 
size^ so as to fit within R's limited span of attention and meet other con- 
straints, is to make the V(R)/V(D) ratio larger, and again increase R's 
versatility. Thus a greatly oversimplified model of cognition consists 
in two very different transformations of variety, both motivated by the 
law of requisite variety toward increased versatility: ' 

1) widening the sensory base by expanded storage (+V(R)). 

2) contracting and simplifying the sensory base by Interposing a set of 
new structures of homomorphic mappings on the sensory base (-V(D)). 

The new structures contain less (or no) sensory variety and more 
relational variety. This, Is intuitively what we expect of an abstraction - 
we cannot recreate It as a scene, sound, odor. ..it has little or no "pictorial" 
content of its own (although, since it is associated with SSI's, It often 
recalls specific SSI's). Its vague sensory content has less to do with struc- 
ture than with function. It stores relations defined on the sets of stored 
SSI's (I-sets). 

As described elsewhere^^^ an abstract concept or abstraction is 
also a class. A class is a mental construct which has two aspects, 

1) a qualitative "decision" rule for class membership or non-membership (intension 

2) a quantitative number of members, (the class extension). In the model 
below, the members are SSI's, and all higher classes are formed from thetn: 

^ We have conjectured the existence of structures in the brain 
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(call them A-sets) derived from naturally associated sets of stored 
sense Impressions (I-sets), Each member of an A-set has the nature 
of a -property" of the I-sets. It 1s also the Intension which defines 
a class. For the special case of an A-sit based on tree-like I-sets 
we suggested a simple model, giving the minimum number of naturally- 
associated SSI's required to form the 1**1 "level": 

N(1) - 2^''' (i-l,2,.,.,m) 

where m Is the highest level constructed within the brain on that 
I-set base. Then the total number of naturally associated SSI's would 
be at least 

N(m) - f n(1) 
1^1 



In this model each successive level contains one more 
naturally associated SSI than the entire sum of all those in lower 
levels. What interpretation can be placed on this rapid increase 1n 
minimum class extension? Again there 1s a straightforward cybernetic 
interpretation: the-levels represent decreasing variety of class inten- 
sion (or partial -patterns) in the set of SSI's which define the class ^ ^ 
1,e,| decreasing contributions to the homomorphisms ^ from each constituent SSI, 
A decrease in variety may be regarded in several ways. Most obviously^ 
It represents a lessening of constra1ntS| so that more objects can be 
found that comply w1th.it as a defining rule for a class, 1*e.s minimum 
class extensiofrHnSlr&aseSi Another aspect Is that^ if range in 
v^rietj^ used to define a field is narrowedj the range in the correspond- 
'Ing ^concepts is narrowed, or the concept stability Increases, That 
is, concept stability would be some inverse function of permisr 
sible range in variety. But class extensionls such an inverse function 
(although not necessarily the correct function). Hence we may regard the 
increasing extension and decreasing intension in the abstractions as 
a measure (of some sort) of increasing conceptual stability . Finally, 
there is another aspect of the same phenomenon/ The, decrease 1n class 
intension also corresponds to increase 1n versatility of response behavior 
on the part of the person whose brain Is involved. There are Innumerable 
examples* For instancei when John 1s fivei the question "how many are two 
cows and three horses?" 1s no posers for he does not see the difficulty. As 
he matures* he senses that cows and horses differ and cannot be added. 
When he has deviloped still more levelSs ha calmly uses an upper levels 
and answers that "two domestic animals and three domestic animals are 
five domestic animals," Thus ha has acquired additivity by use of a 
higher, more abstract Ifvfl, Thi physicist dots the same when hi insists 
on "dimensional homogenlety-' 1n terms of his equations. The mathematician 
strips all the internal structure of Intension from his mental objects^ 
leaving only their externally discriminable structure — their number 
and order, He thus creates the integars, and thereby gains still more 
versatility. Sreater generality Is aquivalant to less defining intension 
of a classi to less variety. And the rule 1s that, the more general the 
class, the more "particular'- cases it subsumes, and the more versatile 
1s the mental owner 1n performing mental operations. 



n(1) = 1 +2+4+8+— +2 
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Now let us look In the opposite direction. At the bottom level 1s 
the SSL It contains the maximum variety we can experience In one obser- 
vation. It has the least versatility. Using only the SSI we cannot 
communicate internally in thought ^ or externally/ in a message. If we 
look a few levels higher ^ we still cannot communicate. For example, we cannot 
communicate level 1. The uniqueness is still too greats i.e., there exist 
no comparable structures in the mind of another p er.qnn. HoweverV at a 
certain level of stability the conciptual structures in two minds begin 
to be sufficiently similar so that the indication of the concept structure 
by one person finds something similar which can respond, in the other 
person. When this hypothesized threshold of stabilit y for communication 
Is reached, there is an enormous Increase 1n versatility. For now the 
two persons can function as a social unit, mutually assisting eachother's 
goals. This hypothetical level we Indicate by n(c), the minimum number of 
naturally-associated SSTs for the threshold conceptual stability necessary 
for interpersonal communication ^ Evidence for the existence pf a 
threshold are the facts that we cannot communicate DSI's and SSI's, and 
that we can and do communicate by signs or s ^mibols that evoke abstract^ 
classes . For levels higher than c, communication becomes easier and easier. 
The probability that our conditioned associations (symbols) evoke abstract 
concepts (1f they are present) becomes better and batter. This idea 
underlies the ease of communication by small groups of professionals 
who share the same sets of abstractions. The precision of mathematical 
concepts, for example, is no accident. The fact that they can be (not 
necessarily always are) so precise Is attributable to their enormous 
suppression of variety. They are actually derived from very large I-sets 
of which the mathematician loses awareness. In fact the difference 
between mathematics and other sciences lies In a kind of superversatll Ity — 
the mathematical concept structure Is not necessarily reconstructed so as 
to embody the constraints on patterns of variety observed in the real 
world of DSI's. Yet one of these constraints persists in a way that the 
mathematician must observe. He uses It as his link with "empirical reality". 
The constraint on his synthetic patterns is that of validity of proof. 
Proofs allow enormous slmplicatlbn (a homomorphic device) since they 
permit suppressing the variety in lower levels of abstraction, and re- 
taining only the reduced patterns at the higher levels. A proof is a ^ 
rule for interlevel transitions, "Inference", in logic. The example 
below applies only to levels of abstraction based on tree-like I-sets, 
as In the simplified model: 

Hypothesis 1: All A is B (if A then B) 

Hypothesis 2: All B is C (1f B then C) 

Conclusion : All A is C (if A then C) 

Assuming the mathematician can demonstrate the truth of the conjunc- 
tion of the hypotheseSi then a valid conclusion followsi and the middle 
term B 1s unnecessary, as in fact Is A, since the whole process is 
designed to show that A also conforms to rule C, This type of constraint^ 
empirical in origin, has the versatnity of applying to any three levels. 
The example merely suggests that logic too Is a device for reducing 
variety, for regulating and controlling It^ i.e,, for Increasing the 
versatility of Its user,^ 

In the discussion so far it has been suggested that the law of 
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requisite variety applies to the gathiring of large quantized units of 

sensory variety (DSrs) stored (as SSrs) in memory banks (I-sets) which 

preserve the combined constraints of body and environment. In order to 

use these data other processes are needed. One of these is the capability, 

given an incident DSIi to extract features, recognize them and classify 

them at once so as to endow the DSI with ''meaning*'. It has been suggested 

that this deductive pattern recognition Is accomplished by the A=sets once 

they are built up In the body inductively, A-sets are partial patterns. 

They act like prisms or diffraction gratings on a beam of white lights 

instantaneously decomposing and analyzing an afferent DSI Into its "A-set 
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spectrum" of "characteristics"* No mechanism is suggested. However^ 
we know this process occurs. We do rapidly understand a DSI "In light of 
of experience". Understanding is not sensory, but relational. The isolated 
DSI or its memory trace SSI has no meaning by Itself . It acquires meaning 
in relation to mental structures previously formed. This power to "deduce'S 
on which our expectations and predictions are basedp represents an enormous 
gain in versatility. It enables man the self-regulator to conduct self- 
advantageous action. 

Two other homomorphic transformations on variety are needed for a 
decision. The first might be called cognitive selection, a binary 
mapping of those alternatives which seem most relevant (in terms of a scan 
of the sets of spectra of characteristics) Into the narrow channel of 
immediate awareness, The second transformation might be called selective 
affective response. It is an ordering of the cognltively selected alternatives 
feelings and drives - decision by self-utility or value. Final ly^ the 
motor discharge In segment I (ab) innovates responsive action. 

All of these processes are immensely complex. Howeveri looked at as 
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a whole they simply increase the capability of the body for self-regulation. 
They can be Interpreted as applications of the cybernetic law of requisite 
variety. 

This discussion renders somewhat more precise our opening remarks. The 
most significant information scientific phenomena do take place in the terminal 
segments of the IS pathi but the third segment (cd) is the more complex 
of the two. It performs the main functions of sensory observations data storag 
data analysis and compression^ cognitive selection. Affective decision is 
not necessarily localized. It may take place "between" segments III and L 
Segment I has comparatively few functions those for propagating the coded 
results of decisions out of the body as signals (stimuli ^ symbols)* across 
segment II, the "insulating gap" between minds. 

We also recognize the logical and practical impossibility of discussing 
what happens in the central segment without also discussing what happens 
in the terminal segments. In nearly every casij all three segments are 
engaged. The temporal and spatial orders^ are preserved and remain invariant. 
Therefore we cannot segregate these operations as long as we consider them as 
parts of one meaningful whole, A possible exception might be use of segments 
II and III in "passive observation" observing nature. It cannot occur 
in observing artifacts (such as messages). For even 1ft in passive reading, 
we are using segment II (a book) and III (visual-mental tract) we are also 
completing as IS path initiated In some segment I, This "holistic" view 
has been used for a simple graph-^theoretical demonstration that an IS path 
has maximal length (therefore can be treated as uniquely defined), not 1n 
terms of a physical space- time interval, but in nurfibers of stpges, or trans-- 
formations of variety . Unique and exhaustivep the IS path can serve as a 
convenient reference frame for two-person comrnuni cation. It allows us to 



describe the information scientific phenomena of pairs (sender and recipient). 
With due caution in making a new operational definition the concept can be 

generalized to its societal (scientific) generaiizations the collection of 
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IS paths or IS domain. 

2* Requisite Variety and IS Path - Segment 11 

In view of the practical inseparabnity of the three segments we 

examine from the viewpoint of cybernetics models of information scientific 

operations which depend typically on artifacts in segment II* The first is that 

of search of a collection. The searcher embodies segments I and III, the 
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.collection is in segment II/' 

The librarian and Information processor perform many professional 
tasks by reducing the variety among documents and other artifacts 
used in. common by society. For example, they construct categories of 
inclusion or hierarchies (precoordinated); or they may set up the 
potentiality of such hierarchies^ or of simple class conjunctions (post- 
coordinated)* The use of precoordlnatlon ("classification") In infor- 
mation search was studied in the model: 

N ^ C K V T 

N represents the number of units (e.g^^ words) in the collection^ T the time 
spent sensing (seconds), V the average rate of sensing (words/second) ^ 
K the ratio of homomorphic compression i and C the ratio of units of the 
original collection to the units still to be sensed. That is, V represents 
the process of sensing and widening the sensory base of stored variety 
(reading), K represents the compression ratio when, e.g,^ a book with 
lOOjOOO words is abstracted to form a new "surrogate" of itself such as 
an abstract or a catalog card containings say, 100 words. Then K ^ ^fjj^ ' 
1000. This is the numerical but not semantic measure of homomorphic compression. 

If the collection contains 1,000,000 volumes and the selection process 
reduces this to 100,000 volumes, the value of C would be ^jQQ^ff " 1P. 
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K and C respectively reflect two of the three suggested basic 
mental processes: homomorphic slmpHf ication and suppression of 
variety; C, isomorphic sensing of variety, coupled with its elimination 
by selection* K and C can both be regarded as homomorphic mapping^ 
processes^ one by compression into a simpler structure with retention 
of certain invariants (the maaning), C by mapping an original structure 
into a binary function (1|0). The result of the latter is to select 
parts of the original without otherwise altering them. 38 

Since, as mentioned , V riprestnts a widening of the sensory base of 

variety, the model simulates three main cognitive processes used 1n 

search of collections* In information search there is a reciprocal use 

of K and C such that the total number of symbols sensed (VT) is kept small, 

and search takes place on the compressed and selected surrogate collection 

(N/CK). Figure 6 shows an "inverse homomorphic" use of a classification 

system. 

During search C Increases from 1 to N (the end of the search, when 
the last word is about to be sensed); while K has one or more constant 
values, which decrease until K - 1, In all cases the manipulation of 
K and C follows a certain order. Since the act of selecting requires 
variety of more than 1, the values of K must be reduced before the 
value of C can be Increased, For example, suppose a system is used 
(somewhat like the Dewey Decimal System) in which the collection is 
first divided into ten parts. If the entire collection were first 
represented by one word, say the word "Collection", then the value of 
K would be, initially 

and no selection could be made from the one word. If however, K were 
reduced so that (decreasing K by a factor of ten) 

^1 " TET 

then it would be possible to select one or more of the ten words. Thus 
the variety in the compressed collection had to be increased from 1 to 10, 
before the selection from a variety of 10 could be made. In any decision 
process, there must be a variety of at least 2. In Information search 
with a classification system we al ternate decompression (the Inverse 
of the homomorphic compression that took place when the more abstract 
class was formed), with selection. We go from the abstract to the 
concrete, always keeping the amount of variety to be handled at each 
stage small (and therefore the sensed message M short). In this way 
the total sensed message: 

M ^ VT - VT. + VT5 "H . . . + VT^ 
I c m 

+M2 . ... + 

■ 38 ■ 



where m corresponds to the lowest, value of K greater than 1. At K = 1 
the nature of the search changes from decision-making (selecting what 
to sense) performed on the hofflomorphlcal ly-mapped image-coll ect1 on to 
sensing the selected part N/C of the original collection. Advantage can 
be taken of this change in function, as described below. The successive 
reductions in K permit the selection process to take place rapidly 
(since at each stage j only the few words M. are sensed) and still 
preserve exhaustive coverage. The homomorpHIc compression represents 
the whole remaining collection at each stage. Note that In the schematic 
search diagram K and C change inversely and alternately with K preceding 
c. The alternation ceases after K - 1 and thereafter the rate of climb 
of C IS much slower, since the "reduction" of the collection now 
occurs only at the ordinary reading rate V. The entire time of search 
can be symbolized by 

VT = VT(K > 1) + VT(K " 1) - M(K > 1) +M(K = 1) M 

in which the length of M and T are controlled by regulating the amount 
of variety used, jo 

Anothir example is that of an indexer using a thesaurus (figure 7).^^ 
Here the disturbance D is the variety in the set of uncontrolled vocabulary 
terms in the literature to be Indexed. This variety "threatens" the correctly 
Indexed or "controlled" vocabulary terms E. The variety in D Is suppressed 
to the lower variety In the controlled vocabulary by Indexer T, whose 
selection Is jointly dominated by D and thesaurus R. 

A third example Is provided by a reference librarian who regulates the 
Interaction of a library user and the library. The user "threatens" (his 
or her own) access to the library's information by his or her variety In 
request for Information or In approach to the system of catalogs, stacks 
and collection. The reference librarian regulates this variety by making 
proper selections following the user's query. The reference librarian in 
turn Is "controlled" by the philosophy or policy of the library (Figure B) .^^ 

Another example is that of a classification system (Figure 9a)*''; such 
as the Dewey Decimal Classification System (DDC) or the Universal Decimal 
Classification System (UDC) or Colon Classification System (Figure 9b). 
The variety in a new concept to be classified (D) "threatens" the set of 
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correctly classified concepts (E). D 1s regulatid by the creators and 
malntainers (R) of classification schemi T* 

The various organizations for maintaining knowledge classif ication 
schemes are not equally effective as regulators. In DDC (Figure 9a)* 
the regulation is by error correction, i,e., the message path from D to R 
is DTER, In UDC and Colon Classification (Figure 9b) the organization of 
maintainers 1s such that the path is either DTK or DR, 

A final example is that of an academic acquisitions system (Figure 10),^^ 
The system E to be protected is the set of orderi (E^ successfully, E_ 
unsuccessfully) filled. The disturbance D 1s the set of academic orders, the 
environment (or "table") T is the acquisitions departmant and vendors, the 
regulator R the acquisitions librarlani and C the fund control against 
overexpenditures. The path is DTR or DTER, 

In conclusion, this paper has briefly outlined the cybernetic concepts 
of variety, its transformations and use 1n regulation through the law of 
requisite variety. To apply these ideas to Information science two "framework'' 
models were sketched, the IS path. and IS domain. Finallyi examples of phenomena 
selected in all three IS path segments suggested how the law of requisite 
variety applies almost universally to transformations on the IS path 
and within the IS domain. Each example differed structurally but was function- 
ally isomorphic. The isomorphism is that of a goal * equilibrium - distur- 
bance configuration. Moreover , In IS the end Is always communication and 
the means regulation of threatening variety. This systematically recurring 
pattern of a goal-seeking type provides an initial theoretical base for 
information science, "Initial" because the law of requisite variety is abstract 
and its constraint functional. We cannot expect it to predict detailed 
structural constraints. It applies to too many situations--not only to regulation 
in information science but to all regulation, with different goals and different 
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equilibrium states. On the other hand we may expect such a broad law to lead 

to further discovery. It should help us discover and fontialize an eventually 

multidisciplinary theory of infomiatlon science by pointing not only to the 

wealth of cybernetic connections but to the fundamental contributions of 
43 

other sciences. 
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